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ABSTRACT 


The main purpose of this article is to review the work on Runge-Kutta Methods to study of Numerical Solutions of Initial 
Value Problems in Ordinary Differential Equations during the period 1983 to the present 2020. A very comprehensive and 
detailed review on Runge-Kutta Methods has been compiled by Hulls from 1983 to 1996 and the authors of present article 
have reproduced it as such with gratitude and sincere acknowledgment. The status on this subject from 1983 to 2020 has 


been compiled by the present authors for the convenience of the new researchers entering in this field 
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INTRODUCTION 


Differential Equations help us to understand phenomena that involves rate of change. These equations are the most 
important mathematical tools in generating models in Engineering, Biological Sciences and Physical Sciences. The 
differential equations are applied as mathematical representations of many actual world problems. For example, differential 
equations help us understand disease spread, weather and climate prediction, traffic flow, financial markets, population 
growth, water pollution, chemical reactions, suspension bridges, brain function, tumor growth, radioactive decay, electrical 
circuits, planetary motion and vibration of guitar strings. An important type of problem that we must solve when we study 
Ordinary Differential Equations is an initial value problem. An "initial value problem" is an ordinary differential equation 
together with the conditions imposed on the unknown function and the values of its derivatives in a single number is called 
an Initial Value Problem. At some point, the initial value problem is too complicated to solve exactly, and one of two 
approaches is taken to approximate the solution. The first approach is to simplify the differential equation to one that can 
be solved exactly and then use the solution of the simplified equation to approximate the solution to the original equation. 
Numerical Methods are generally used to solve mathematical problems that are formulated in science and engineering, 
where it is difficult to get an exact solution, only a few differential equations can be solved analytically. There are several 
analytical methods for solving ordinary differential equations. But there are a lot of ordinary differential equations that 
cannot be solved analytically. At that stage we have to use the Numerical Methods to solve this type of Ordinary 
Differential Equations. There are several Numerical Methods for solving Initial Value Problems. While studying literature, 
we came across the numerous works of numerical solution of Initial Value Problems applying the Runge-Kutta first-order 


method, the Runge-Kutta second and third order methods, and the Runge-Kutta fourth-order method have been carried out. 
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Numerous authors have tried to solve initial value problems to obtain good precision using the methods mentioned above. 
Hull et.al [1996] worked on in detailed about the literature of the Runge-kutta method from 1957 to 1996. Further review 


of literature from 1997 to 2020 has been compiled by the present authors. 
Numerical Method 


Numerical method forms an important part of solving initial value problems in ordinary differential equations, most 


especially in cases where there is no closed form solution. Next we will present numerical Runge-Kutta Methods. 
Runge-Kutta Method 


Runge-Kutta Method is a technique for approximating the solution of ordinary differential equation. This technique was 
developed around 1900 by the mathematicians Carl Runge and Wilhelm Kutta. Runge-Kutta Method is popular because it 


is efficient and used in most computer programs for differential equation. 
The following are the orders of Runge-Kutta Method as listed below: 
e Runge-Kutta Method of order one is called Euler’s Method. 
e Runge-Kutta Method of order two is the same as modified Euler’s or Heun’s Method. 
e Runge-Kutta Method of order three. 
e = The fourth order Runge-Kutta Method called classical Runge-Kutta Method. 
Solution of Ordinary Differential Equations 
Runge’sKutta Method: By this method we are able to find the increment k of y corresponding to an increment h of x 
from = f (x,y), 9%) = Yo 


Runge-Kutta Formulae 
I“Order : 
e Euler’s Method is Runge-Kutta Method of 1“ Order 


Yn+1 = Yn + hf Xn Yn) 


Il"Order : 
© k, =hfnYn) 
© ky = hlx; + hy yn + bFXn, nd] 
© Yner =Yn +5 [ky + ky] 
II"Order : 
e = ky = hf (Xp, yn) 
© ky =hf (x, +2,yn +2) 


© ky =hf(x, thy, + 2k, —k,) 
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© Yn+1 =n + elk, + 4k, + ks] 
IV" Order 

ek, = hf (%q, Yn) 

© kp =hf(%,+2,y, +) 

© kj =hf(x, +*,yn +2) 

e ky = hf(x, + hyp + Ks) 


© Yn41 =Yn + = [k, + 2k, + 2k3 + k,], where, n= 0,1,2,3,...... N — 1 where N is the number of subintervals. 


REVIEW OF LITERATURE FROM 1983 TO 2020 


A new theme, which has led to several new initiatives during this period, is the development of continuous methods. A 
major new implementation project is also being undertaken during this period, along with expanded testing facilities for 
assessment and comparison of new methods. Another theme is the development of parallel methods. Much of the work in 


this period is surveyed in a 1994 paper by Enright, Higham, Owren and Sharp [1994]. 


Owren and Zennaro [1991,1992], Muir and Owren [1993], and Verner [1993]. Effectiveness theory has been 
extended to this class of methods and continuous Runge-Kutta formulas of orders four to eight have been analyzed from this 
point of view by Enright [1993] Continuous extensions of Runge-Kutta formulas have also been applied to singular initial- 
value problems by Enright and Suhartanto [1992].An implementation of an explicit Runge-Kutta code for initial-value ODE 
problems, known as TERK [1986], based on these new results has been under development for some time, and is now nearing 
completion. The work on TERK also motivated research on global error estimates by Peterson [1986] and Higham [1991] and 
on stiffness detection by Robertson [1986]; it is planned to incorporate these capabilities in a future version of TERK. Some 
special Runge-Kutta formulas have been developed and implemented for boundary-value problems by Muir [1984] and 
Enright and Muir [1986]. Still others have been developed and implemented for first-order problems by Sharp [1989], and 
second-order problems by Sharp [1987] and Sharp and Fine [1987,1992] (but these last four do not involve continuous 
extensions). Investigations related to the assessment and comparison of numerical methods have continued. Sharp [1991] has 
developed new formats for viewing and reporting the results of comparisons and he has introduced an option into DETEST to 
report statistics in this format. For the comparison of different continuous methods, an extended version of DETEST, called 
X-DETEST, has been written which reports other measures of error such as the maximum defect and the maximum global 
error of the continuous approximation. DDETEST, another test program that measures performance based on maximum 
global error and the size of the defect, is being developed for the assessment of methods for delay differential equations. It 
uses a collection of twenty-one test problems, and it stores the "true solution" as piecewise polynomials, obtained using high- 
precision arithmetic. Several aspects of parallelism have been considered during this period. The potential for parallelism in 
standard Runge-Kutta Methods has been studied by Jackson and Norsett [1995]: both negative and positive results are 
presented. Many of the negative results are based on a theorem that bounds the order of a Runge-Kutta formula in terms of the 
minimal polynomial associated with its coefficient matrix. The positive results are largely examples of prototypical formulas 
which offer a potential for effective "coarse-grain" parallelism on machines with a few processors.Runge-Kutta predictor-- 


corrector methods have been discussed by Enenkel [1988], and analysed by Jackson, Kvmmo and Norsett [1994]. The results 
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in the last two papers are of value not only for the development of parallel ODE codes, but also for the efficient, reliable and 
robust implementation of implicit Runge-Kutta methods on standard sequential machines.Onumanyiet.al.[1999] studied 
continuous finite difference approximations for solving differential equations”. Gander [1999] gave a thoughtful consideration 
on the derivation of numerical methods using computer algebra.Hong[2000] worked on “The calculation of global error for 
initial value problem of ordinary differential equations”. Ling [2000] studied some Application of Runge-Kutta—Merson 
Algorithm for Creep Damage Analysis. Further, Boyce [2000] worked on Elementary Differential Equations and Boundary 
Value Problems. Runge-Kutta with higher order derivative approximations was appeared in a paper by Goeken and Johnson 
[2000].Pimenov [2001] provides general linear methods for the numerical solution of functional — Differential Equations. 
Bernardo and Wang [2001] gave some aspects about Runge-Kutta discontinuous Galerkin Methods for convection-dominated 
problems. Awoyemi [2001] discovered a new sixth-order algorithm for general second order Ordinary Differential Equation. 
Fredebeul et.al. [2002] worked on multiple order double output Runge-Kutta Fehlberg formulae and some strategies for its 
efficient applications. Murugesan[2002] have studied a fourth order embedded Runge-Kutta Method based on arithmetic and 
centroidal means with error control. Awoyemi [2003], studied A P-stable linear multistep method for solving general third 
order ordinary differential equations. Also, Butcher [2003] give detailed studies on Numerical Methods for Ordinary 
Differential Equations. Biazar et.al.[2004]obtained solution of the system of ordinary differential equations by Adomian 
decomposition method. Ruuth [2004] studied the global optimization of explicit strong—stability preserving Runge — Kutta 
methods. Awoyemi[2005]studied a class of hybrid collocation methods for third-order ordinary differential equation. Further, 
Mathews [2005] gave many results about the book Numerical Methods for Mathematics. Majid[2006]worked on higher order 
systems of Ordinary Differential Equations block backward differentiation formula for solving first-order Ibrahim [2007] 
worked on “Implicitr-point block backward differentiation formula for solving first-order stiff ODEs,” Bosede et. al. [2012] 
gave some numerical methods in their famous paper entitled “On Some Numerical Methods for Solving Initial Value 
Problems in Ordinary Differential Equations”. Also, Ogunrinde [2012] studied some numerical methods for solving Initial 
Value Problems in Ordinary Differential equations. Rabiei [2012] improved the Fifth-order Runge-Kutta method for solving 
ordinary differential equation. Islam [2015] analysed the accuracy of Numerical Solutions of Initial Value Problems (IVP) for 
Ordinary Differential Equations (ODE). He also gave the accurate solutions of Initial Value Problems for Ordinary 
Differential Equations with the fourth order Runge Kutta Method. Further, Islam in [2015], performed a comparative study on 
numerical solutions of initial value problems (IVP) for ordinary differential equations (ODE) with Euler and Runge-Kutta 
methods. Gowri et.al [2017] discussed about Runge-Kutta Fourth Order Method with Differential Equations and its 
Application. The Differential Equation problems hasbeen solved by Runge-Kutta fourth order method and application 
problem are discussed with Runge-Kutta fourth order. He concluded that Runge- Kutta fourth order Method gave more 
accurate results. Sadiq et.al [2017] worked on using fourth order Ruge-Kutta Method to solve Lii Chaotic System. He 
observed that the accuracy of Runge-Kutta fourth order method solution can be increased by lessening the time step and 
shows that Runge-Kutta fourth order method successfully to solve the Lu system. It has been determined the accuracy of 
method using symmetrical times. Hossain[2017] worked on a paper entitled “A study on the Numerical Solutions of Second 
Order Initial Value Problems (IVP) for Ordinary Differential Equations with Fourth Order and Butcher’s Fifth Order Runge- 
Kutta Methods”. Hamed, [2017] gave the accuracy of Euler and Modified Euler technique for first order ordinary differential 
equations with initial conditions.Samsudinet.al.[2018] worked on “Cube Arithmetic: Improving Euler Method for Ordinary 
Differential Equation Analysis and Comparative Study of Numerical Solutions of Initial Value Problems (IVP) in Ordinary 
Differential Equations (ODE) With Euler and Runge-Kutta Methods. Anthony [2019] et.al. Analysed and Compared the 


Numerical Solutions of Initial Value Problems. He compared the performance and the computational effort of the two 


Impact Factor (JCC): 6.2284 NAAS Rating 3.45 


Review Paper on the Runge-Kutta Methods to Study Numerical Solutions of Initial Value 19 
Problems in Ordinary Differential Equations 


methods. In addition, to achieve more accuracy in the solutions, the step size needs to be very smallN Jamali [2019] produced 
the analysis and the comparative study of Numerical Methods to solve Ordinary Differential Equations with Initial Value 
Problems. Mohammad et.al [2020] worked on a Comparative exploration on different Numerical Methods for solving 
Ordinary Differential Equations. In this paper, the Initial Value Problem of Ordinary Differential Equations has been solved 
by using different Numerical Methods namely Euler’s method, Modified Euler method, and Runge-Kutta Methods. He 
analysed to determine the accuracy level of each Method. By using MATLAB Programming language first we find out the 
approximate numerical solution of some ordinary differential equations and then to determine the accuracy level of the 
proposed methods we compare all these solutions with the exact solution. It is observed that numerical solutions are in good 
agreement with the exact solutions and numerical solutions become more accurate when taken step sizes are very much small. 
Mohammad et.al [2020] worked on a comparative exploration on different numerical method for solving ordinary differential 
equations. In this paper, the initial value problem of Ordinary Differential Equations has been solved by using different 
Numerical Methods namely Euler’s method, Modified Euler method, and Runge-Kutta method. Here all of the three proposed 
methods have to be analysed to determine the accuracy level of each method. By using MATLAB Programming language 
first we find out the approximate numerical solution of some ordinary differential equations and then to determine the 
accuracy level of the proposed methods we compare all these solutions with the exact solution. It is observed that numerical 
solutions are in good agreement with the exact solutions and numerical solutions become more accurate when taken step sizes 
are very much small. Lastly, the error of each proposed method is determined and represents them graphically which reveals 
the superiority among all the three methods. We fund that, among the proposed methods Runge-Kutta 4th order method gives 


the accurate result and minimum amount of error. 
CONCLUSIONS 


We have tried to go through each and every research article on this subject till date. It is very clear from this compilation 
majority of the work on this topic comes from the workers overseas they have dealt mainly with the accuracy and 
comparative analysis on Runge-Kutta first order second order third order and fourth order method. This review reflects that 
there is hardly any report of work available in the Indian scenario. Hence there is strong need of taking up detailed studies 


on this problems which will prove beneficial in solving the initial value problems. 
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